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5 Image Detecting sSystem 

Background of the Invention 

1 0 The invention relates to a device for detecting and storing digital pictures comprising an 
image detector for the generation of digital picture data and a picture processing device 
with a picture data memory. 

Furthermore the invention relates to a method of detecting, processing and storing digital 
1 5 pictures with a digital camera. 

It is known to take pictures with a digital camera, whereby digital picture data are 
generated, to process these digital picture data and to store the picture data in a data 
memory. Such digital cameras usually have a CCD image detector. CCD (charge coupled 
20 device) image detectors are well known in the literature, and, for example, described in 
the books "Laserspektroskopie" by Wolfgang Demtroder, 3 rd Edition, Springer- Verlag 
Berlin Heidelberg New York or Bergmann Schaefer "Lehrbuch der Experimentalphysik", 
FestkSrper (solid state bodies). Volume 6, de Gniiter Verlag. 

25 Such CCD image detectors consist of a plurality of CCD sensors assembled in a matrix. 
Each CCD sensor provides color or gray value information for one picture element 
(pixel). This information is read as digital number. Good CCD sensors have a dynamic 
range of 10 bit or more. In principle, at least 2'* color or gray values can be represented 
with such a system. Current picture display systems usually operate with only 8 bit gray 

30 values. Therefore, the 256 gray values which can be displayed with such a system arc not 
sufficient to make full use of the complete dynamic range of the CCD sensors. 
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Such image detecting and picture processing systems are used in traffic monitoring 
installations operating with a digital camera. Traffic monitoring installations serve to 
detect violations of traffic regulations, such as speeding or passing a red traffic light, by a 
5 vehicle driver. Such traffic monitoring installations would provide an optimal picture for 
prosecution of the violation, if both the driver in the comparatively dark passenger 
compartment of the vehicle and the bright license plate could be well recognized. This is 
not possible with the presently available image detecting systems. Either the dark 
portions of the pictures are too dark, if the picture of the license plate is optimally visible, 

10 or the bright portions of the pictures are too bright, if the driver is optimally visible in the 
dark passenger compartment. Thus, when a vehicle is photographed with a digital 
camera, either the driver in the dark passenger compartment cannot be recognized dearly, 
or the bright license plate is subject to blanketing and cannot be read, depending on the 
utilized partial brightness range of the whole dynamic range of the CCD image detector. 

15 This results often in considerable problems in particular with the subsequent picture 
processing. The pictures have to be unambiguously identified both with respect to the 
driver and to the license plate, in order to serve as evidence in court. 

Disclosure of the Invention 

20 

It is an object of the invention to provide a device and a method of picture display with 
which the information obtained by CCD sensors can be taken advantage of to optimal 
extent. 

25 To this end, a device for detecting and storing digital pictures is provided, comprising an 
image detector tor the generation of digital picture data and a picture processing device 
with a picture data memory, wherein means are provided for generating, from an image 
detected by the image detector, both a relatively dark picture and a relatively bright 
picture. 
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A method of detecting, processing and storing digital pictures with a digital camera 
comprises the step of generating at least two digital pictures having different degrees of 
brightness. 

5 The invention is based on the discovery that, with conventional digital image detecting 
systems using CCD sensors as, for example, employed in digital cameras of traffic 
monitoring installations, the dynamic range of the CCD sensors is not taken advantage of 
to optimal extent Therefore, the basic concept is to generate at least one relatively dark 
picture and one relatively bright picture, these pictures utilizing substantially the whole 
10 dynamic range of the CCD sensors. By providing at least two pictures having different 
brightness components, it becomes possible to better recognize the license plate on one 
picture, the "dark" picture, and the driver on the other picture, the "bright" picture. This is 
done by reading out the CCD sensors differently. 

1 5 The dark picture may, for example, be generated by reading out the eight least significant 
bits of the CCD sensors. These eight least significant bits contain more useful 
information about the bright components of the picture. The dark picture permits more 
easy identification of the license plate appearing very bright as compared to the passenger 
compartment. In the dark picture, however, the driver appears, at best, as a dark shadow 

20 only. Therefore, the bright picture is generated using the eight most significant bits of the 
CCD sensors. These eight more significant bits contain more useful information about 
the dark components of the picture. Thereby, the bright picture permits recognition of ihe 
driver without problems. In this bright picture, the white license plate is seen as a bright 
area only, which does not permit recognition of the license number. With the two 

25 pictures, the dynamic range of a 10 bit CCD sensor is taken advantage of to full extent. 

Advantageously, the two digital pictures are combined. To this end, means for mixing the 
picture containing with the bright components and the picture with the dark components. 
A single picture is generated, which may look a little artificial, in which, however, both 
30 the license plate and the driver can easily be recognized. 
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Furthermore, picture balancing means may be provided for balancing the images to be 
detected in accordance with a priori available information, for example when exposures 
are made at daytime or at night. To this end, a histogram is used giving the statistical 
distribution of, for example, the gray values of the various picture elements or pixels in a 
5 picture. At first, such histogram is generated from a test "dark" picture, in which the 
license number can be read clearly from the license plate. In such a histogram, a certain 
high percentage of the gray values is below a certain level. This level serves as a 
reference. This is a priori information. Then a first picture of a vehicle is taken, with the 
digital camera in actual use- A histogram is generated from this first picture. The 

10 balancing means check, which percentage of the pixel gray values is below the reference 
level. If the percentage is higher than in the test picture, the picture may be too dark. The 
diaphragm of the camera is then opened or the exposure time is increased by one step for 
the next exposure. If the percentage of gray values below the reference level is lower than 
in the test picture, which means that more gray values are above the reference level, the 

1 5 Mark* picture may be too bright due to daylight iuumination of the photographed scene. 
Therefore., the diaphragm of the camera is closed or the exposure time is reduced by one 
step for the next exposure. Thus each picture is used to improve the quality of the next 
picture and to approximate the quality of the test picture. Thus the digital camera adapts 
itself to the gradual variations of, for example, the daylight illumination. 

20 

Brief Description of the Drawings 

Fig. I is a schematic illustration in the form of a block diagram of an image 

detecting system 

25 

Fig. 2 is a schematic illustration of a method of detecting* processing and storing 

digital pictures with a digital camera. 

Preferred Embodiment of the Invention 

30 

Fig-1 is a schematic illustration in the form of a block diagram of an image detecting 
system for detecting and evaluating an image by means of a digital camera. Preferably, 
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such image detecting system is used in a traffic monitoring installation for watching 
traffic. Referring to Fig. 1, numeral 10 designates a CCD detector. The CCD detector is a 
picture detector as used in digital cameras. In the present case, the CCD detector 10 has a 
dynamic range of 10 bit This is illustrated by ten fields 12. Of course, also CCD sensors 
5 having a larger dynamic range can be used, and the invention is not limited to this 
embodiment. 

The least significant bit of the CCD sensor, the field 12 labeled "0", represents the 
darkest picture component. The most significant bit, the field 12 labeled "9", represents 
10 the brightest picture component The intermediate bits of the CCD sensor represent 
increasingly bright picture components. 

The picture data read out of the CCD sensor 10 are filed once as a so-called "dark" 
picture 16 and once as a "bright" picture in a picture data memory 14 shown in dashed 

15 lines. The dark picture is generated by reading out the eight least significant bits of the 
CCD sensor 10. Accordingly, the bright components of the picture are represented in this 
dark picture with high precision and are not subject to blanketing. The bright picture 1 8 is 
generated by reading out the eight most significant digits of the CCD sensor 1 0. In this 
bright picture, the dark components of the picture can be recognized best, as t because of 

20 the "overexposure", they are optimally illuminated. Lines 20 represent the reading out of 
the eight least significant bits. Lines 22 represent the reading out of the eight most 
significant bits. 

The operational sequence of the digital picture processing is controlled by a programmed 
25 processor. The connecting lines of the individual blocks in Fig. I are appropriate electrical 
connections or electrical circuits or program components for realizing the described 
events. 

Both the dark picture 16 and the bright picture 18 are balanced by means of a picture 
30 balancing device 24 with a respective histogram 26 for optimization. The histogram 
contains s as data, information which result from pictures token previously and optimized 
correspondingly. This information is introduced into the newly taken digital pictures to 
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be processed. Such information may be, for example, data relating to the light, color or 
gray situations, or contrasts etc. 

The picture balancing serves to selectively optimize only those data of the pictures which 
5 are relevant for the subsequent evaluation, in a traffic monitoring installation, these 
picture data are the data representing the license plate and the passenger compartment. 
The remaining picture data are of minor importance. 

Supplying the picture data of the dark and bright pictures 1 6 and 1 S to the picture 
10 balancing device, is illustrated by arrows 28 and 30, respectively. From the picture 
balancing device 24, the picture data from the dark and bright pictures are, in turn, 
supplied to a picture mixer 32, as illustrated by arrow 33. The picture mixer composes a 
single picture 34 from the optimized dark picture 18 and the optimized bright picture 18, 
This composed picture ist stored in a memory 36, as indicated by arrow 38, The 
15 composed picture 34 is illustrated as a block in dotted lines in the memory 36, 

Mixing of the pictures 1 6 and 1 S is effected by placing the relevant picture components 
of the dark picture 16, for example the bright license plate and the headlights, at the same 
position into the bright picture. Thereby, both the passenger compartment with the driver 
20 and the license plate can be recognized precisely on one single picture. 

The composed bright/dark picture 34 can be outputted from the memory 36 for further 
processing or for display on a screen. This is illustrated by block 40 representing an 
output device. Arrow 42 represents the data transfer to the output device. 

25 

Referring now to Fig.2 t the corresponding method steps are illustrated in the form of a 
block diagram. The block diagram shows, how the method basically proceeds in 
accordance with the invention. The picture data are read out from the CCD sensor 10, 
The reading-out process is illustrated by block 44. By the reading out, a dark picture and 
30 a bright picture are generated. This is symbolized by block 46. Subsequently, both the 
dark and the bright picture are stored in a memory. This is shown by block 48. The 
balancing of die pictures thus generated with a histogram is shown by block 50. The 
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mixing of the bright picture and the dark picture is shown by block 52. This composed 
picture, eventually, is filed in a memory. This is shown by block 54 of the diagram. From 
there, the picture data can be retrieved by a further device, for further processing such as 
compression or evaluation by means of character recognition or may be outputted by an 
5 output device such as a screen or a printer. The further processing of the picture data or 
their outputting is represented by block 56. 



